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In this paper we study strong approximations (invariance princi- 
ples) of the sequential uniform and general Bahadur-Kiefer processes 
of long-range dependent sequences. We also investigate the strong and 
weak asymptotic behavior of the sequential Vervaat process, that is, 
the integrated sequential Bahadur-Kiefer process, properly normal- 
ized, as well as that of its deviation from its limiting process, the 
so-called Vervaat error process. It is well known that the Bahadur- 
Kiefer and the Vervaat error processes cannot converge weakly in the 
i.i.d. case. In contrast to this, we conclude that the Bahadur-Kiefer 
and Vervaat error processes, as well as their sequential versions, do 
converge weakly to a Dehling-Taqqu type limit process for certain 
long-range dependent sequences. 

1. Introduction. Assume that we have a stationary long-range depen- 
dent sequence of standard Gaussian random variables, r]i,r]2, ■ ■ ■ ,r]n, ■ ■ ■ , that 
is, the Gaussian sequence {rin,n > 1} with E771 = and Er/^ = 1 is assumed 
to have a positive covariance function of the form 

(1.1) ^{k):=E{r]irjk+i) = k-^L{k), 0<D<1, 

for large k, where L(-) is a slowly varying function at infinity in the sense 
that 

lim LliEll = I for every t G (0, 00). 
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Let G be an arbitrary real-valued Borel measurable function on the real 
line M, and consider the subordinate process 

(1.2) X„ = G(r?„), n>l, 

with marginal distribution function F[x) = P[X < x), x S M, where X = 
G{r]) and r/ is a standard normal random variable. 

Assumption (1.2) allows one to use the theory of nonlinear functionals of 
Gaussian processes. As in [20], we expand the function I{Xn <x) — F{x) = 
I{G{-) < x) — F{x) in Hermite polynomials, for any fixed x € M, 

oo 

I{Xn <X)- Fix) = J2 Cl{x)Hi{lJn)/n, 

l=Tx 

where 

Hiix) = (-l)'e-V2iLe-xV2^ / = 1, 2, . . . , X G M, 
ax' 

is the lib. Hermite polynomial, 

q(x) = E{[/(G(??) < x) - F{x)]Hi{r])}, 

and Tx for any x G M is the index of the first nonzero coefficient in the 
expansion, called the Hermite rank of the function /(G(-) < x) — F{x). We 
note in passing that, by the Cauchy-Schwarz inequality, 

\ci{x)\<E{Hf{r^)) = ll. 

As in [20], the Hermite rank of the class of functions {I(Xn < x) — 
F{x),x G M} is defined by 

(1.3) r = minjrj,. : (x) ^ for some x G M}, 

that is, r = infxTx- If we assume that F is continuous, then the induced 
sequence of random variables 

(1.4) Un = F{Xn)=F{G{7]n)), n > 1, 

is a Uniform- [0, 1] random sequence. Consequently, for any fixed y G (0, 1), 
the function {I{Un <y) — y) = {I{F{G{-)) <y) — y) has the Hermite expan- 
sion 

oo 

I{Un<y)-y = Y.Ji{y)Hi{r^n)/l\, 

l=T 

where 

My) = E{[/(F(G(7?)) <y)- y]Hi{r,)}. 



BAHADUR-KIEFER AND VERVAAT ERROR PROCESSES 3 

Obviously, Ji{y) = ci{Q{y)) for any y £ (0, 1), where Q is the quantile func- 
tion of F, that is, 

Qiy) = F-\y) = \ni{x : F{x) = y}, < y < 1, Q(0) = Q(0+), 

and, hence, the Hermite rank of the class of functions {I{Un l^y) — y,y £ 
(0, 1)} is also r. 

Given chronologically ordered samples Xi,. . . , and Ui, . . . ,Un, n> 1 , 
as in (1.2) and (1.4), respectively, their corresponding sequential empirical 
distribution functions are 

0, 0<t<l/n, 

^ [nt] 

0<y<l,l/n<t<l, 




[nt] 



0<t<l/n, 
-oo < a; < c», 1/77, < t < 1. 



^ [nt] 



i=l 

Based on these functions, we define the sequential empirical quantile func- 
tions 

U[nt]{y) = E[rd] ^{y) = ini{s:E[rd]{s)>y}, < y < 1, 
U^t]iO) = U^t]{0+), 0<t<l, 

and 

Q[nt]{y) = F[nt] \y) =inf{a;:F[„t](x) >y}, < y < 1, 

qh(o)=q;5(o+)' o<t<i. 

Now the corresponding sequential uniform and general empirical and quan- 
tile processes are defined by 

an{y,t) = d-\nt]{E^t]{y) -y), < y < 1,0 < t < 1, 

Un{y, t) = d~^[nt]{y - if^t] (y)), 0<y<l,0<t<l, 
Pn{x, t) = [nt\{F^t] {x) - F{x)), -00 < x < 00, < t < 1, 
7„(y, t) = d-^[nt]{Q{y) - Q^]{y)), 0<y<l,0<t<l, 

where 

(1.5) d2=n2--^L-(n), 

with D of (1.1) so that < D < 1/r, where r is defined in (1.3). 
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By Theorem 3.1 of [31], one arrives at 



Yar {nFn{x)) ~ n 



2-tDtt 



OK) 



t\{2-tD){1-tD) 



for each fixed x € M as n ^ oo, where the symbol ^ means asymptotic 
proportional equivalence. This explains the choice of dn as defined in (1.5) 
for defining the above sequential empirical and quantile processes. 

Dehling and Taqqu [19, 20] studied the asymptotic properties of the 
sequential general empirical process l3n{x,t). The following important two- 
parameter weak convergence theorem for is due to Dehling and 
Taqqu [20] whose Theorem 1.1 reads as follows. 

Theorem A. Let the stationary subordinate process {X„,n > 1} be as 
in (1.2) with r as in (1.3), and let dn be as in (1.5). Then, as oo, 

{Pn{x,t);-oo<x<+oo,0<t<l} 

converges weakly in D[—oo,+oo] x [0,1], 

equipped with the sup-norm, to 



where Yr{t) is l/r! times a Hermite process of rank t, given for each t G [0, 1] 
as a multiple Wiener-Itd-Dobrushin integral that is defined in (1.7) of [20]. 

Thus, in Theorem A, rlYr^t) =: Zr{t) is a Hermite process of rank r, 
a self-similar, stationary increment process with self-similarity index H = 
1 — rD/2, Q < D < l/r, which, as shown in [21, 31, 33], can be represented 
as the multiple Wiener~It6 stochastic integral 



with respect to a standard Wiener process (Brownian motion) W{x), 
E{dW{x)Y = dx, where 




0<D<1/t, 





i=l 



and 
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with B{-, •) denoting the beta-function. 

For a general theory of multiple stochastic integration and Hermite pro- 
cesses, we refer to [27]. 

We also note that Dehling and Taqqu [19] obtained a functional law of 
the iterated logarithm as well for in D[—oo,+oo] x [0, 1]. 

Remark 1.1. We recall (cf. [29]) that, in the i.i.d. case, the weak limit 
of Pni-c,t) is a two-time parameter Gaussian process in x and t, the so- 
called Kiefer process on account of the landmark Kiefer [25] paper, which 
is a Brownian bridge in x and a Wiener process (Brownian motion) in t. 
The Dehling-Taqqu [20] limit in Theorem A differs greatly from the Kiefer 
process. Namely, it separates the variables in x and t in terms of being the 
product of a deterministic function in x and a stochastic process in t which 
is non-Gaussian when r > 2. In particular, if in (1.2) G{x) = x, then r of 
(1.3) is equal to 1, and Yi{t) = Zi{t) of Theorem A is a fractional Brownian 
motion with self-similarity index H = 1 — D/2, < D < 1. If G{x) = x'^, 
then T = 2, and Y2(t) of Theorem A equals 2~^Z2{t), where Z2{t) is non- 
Gaussian, has stationary increments and the same covariance as Zi{t) but 
with H = 1 - D, < D < 1/2. It is caUed the Rosenblatt process (cf. [31]). 
For details on the latter two examples, and on that of Hermite rank r > 2, 
we refer to pages 1770-1771 of [20]. 

Assuming that F has a Lebesgue density function / on M, Csorgo and 
Mielniczuk [15] showed that the kernel estimators based density process 
corresponding to the general empirical process /3„(x,l) converges weakly 
with the same normalization to the derivative of the limiting process in 
Theorem 1.1 of [20] that we quoted as Theorem A here. 

We note that, with F continuous, we have 



Hence, if F is continuous, all strong and weak asymptotic results hold true 
simultaneously for both j3n{x,t) and a„,(y,t). 

For further reference, we spell out the weak convergence result that follows 
from Theorem A for a„(y,t) = f3n{Q{y),t), y,t £ [0, 1], based on the induced 
sequence {Un,n > 1} as in (1.4). 

Corollary A. With F continuous and r and D as in (1.3) and (1.5), 
respectively, as n —> oo we have 



an{y,t) = Pn{Q{y),t) 



y,te [0,1], 



and 



Pn{x,t) = an{F{x),t) 



xGM,t G [0,1]. 
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{2 - tD){1 - tD) 



Jr{y)Yr{t) 



in Z)[0, 1]^ that is equipped with the sup-norm, where, as before, Yr(t) is 
1/r! times a Hermite process of rank t, given for each t G [0, 1] as a multiple 
Wiener-Ito-Dohrushin integral as in, and right after. Theorem A. 

In this paper we go further along these Unes and estabhsh strong approx- 
imations of the sequential uniform and general quantile processes, and of 
the sequential Bahadur-Kiefer processes as defined in (1.7) and (1.8) below. 
Moreover, we also study the sequential uniform Vervaat and Vervaat error 
processes of (1.10) and (1.11), respectively, along the same lines. 

Since there is no simple relationship between u„(y,t) and 7„(y,t), fol- 
lowing Csorgo and Revesz [7] in the i.i.d. case along the lines of Csorgo 
and Szyszkowicz [11], here too we shall consider the normalized sequential 
general quantile process 

Pn{y,t) = fiQ{y)hniy,t) = d-'[nt]f{Qiy)){Qiy) - Q^^iy)) 

(1.6) 

-u(y t)_^M^ 
-""^^''V(Q(^n(^,t)))' 

where < y,t < 1, \y — 9n{y,t)\ <\y — U[nt]{y)\^ provided that F is an ab- 
solutely continuous distribution function with a strictly positive Lebesgue 
density function / on the real line. 
We define the stochastic processes 



(1.7) 
and 



{Kiy,t),0<y<l,0<t<l,n = l,2,...} 

= {dn{an{y,t)-Un{y,t)),0<y<l,0<t<l,n = l,2,...} 



{Rn{y,t),0<y<l,0<t<l,n = l,2,...} 

(1.8) = K(a„(y,t) - prriy, t)),0< y < 1, < t < 1, n = 1, 2, . . .} 

= {dn{Pn{Q{y),t) - pn{y, t)),0< y < 1, < t < 1, n = 1, 2, . . .}, 

which rhyme with the uniform and general Bahadur-Kiefer processes, re- 
spectively, in the i.i.d. case that enjoy some remarkable asymptotic prop- 
erties (cf. [1, 23, 24] and Remark 1.2 below). For a review of, and con- 
tributions to, various aspects of this subject in the i.i.d. case, we refer to 
[4, 5, 6, 8, 9, 10, 11, 14, 30] and the references therein. 

Remark 1.2. It follows from the results of Kiefer [23, 24] that, in the 
i.i.d. case with dn = a„i?*(-,l) cannot converge weakly in L'[0,1] to 
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any nondegenerate random element of the latter space for any normalizing 
sequence {a,„} of positive numbers. Vervaat [34, 35] argued this point in a 
crucially elegant way by showing that, in the i.i.d. case, in the space C[0, 1] 
(endowed with the uniform topology), 

(1.9) K(s, 1) := 2 r Rl{y, 1) dy ^ B\s), n ^ oo, 

JO 

where B{-) is a Brownian bridge. Accordingly then, if at all, a„i?*(-,l) 
should converge weakly to a random element, say, !"(•), in Z)[0,1], and we 

would then have to have the equality in distribution ^^Y{ii)dy = B'^{s)/2, 
< s < 1. This, however, is impossible, for a Brownian bridge B{-) is almost 
surely nowhere differentiable. Vervaat [34, 35] established the above weak 
convergence of V^(-,l) to the square of a Brownian bridge B^{-) by show- 
ing that lim„^oo supQ<j,<;^ [^1(5, 1) — a^(s, 1)| = in probability. In view of 
this, one can think of the process Qn{s-, 1) := Vn{s, 1) — a^{s, 1), < s < 1, 
as the remainder term in the representation Vn{s,l) =a^(s,l) +(5„(s,l), 
< s < 1, of the uniform Vervaat process V^(-, 1) in terms of the square of 
the uniform empirical process a^(-,l). It is well known (cf., e.g., [36] for 
details and references) that (5n(',l) is asymptotically smaller than q^(-,1). 
Csorgo and Zitikis [12, 13, 14] and Csaki et al. [4] call this remainder term 
Qni'i 1) the Vervaat error process, and study its strong and weak pointwise, 
sup-norm and Lp-norm asymptotic behavior for i.i.d. samples a la Kiefer 
[24] and Csorgo and Shi [9, 10]. Csorgo and Zitikis [13] and Csaki et al. 
[4] conclude that, just like the Bahadur-Kiefer process, in the i.i.d. case, 
inQni,'^^) cannot converge weakly to a nondegenerate random element in 
-D[0, 1] for any sequence {a„} of positive real numbers. 

In view of our discussion in Remark 1.2, based on i?,* (•, •) as in (1.7), we 
now introduce the integrated Bahadur-Kiefer process 

(1.10) Vnis,t) = 2d-^[nt] r R*Jy,t)dy, 0<s<l,0<t<l, 

Jo 

the so-called sequential uniform Vervaat process, and define the sequential 
Vervaat error process Qn{s,t) by 

(1.11) Qn{s,t) = Vn{s,t)-al{s,t), 0<s<l,0<t<l. 

We shall see in this paper that, unlike in the i.i.d. case (cf. Remark 1.2), 
when appropriately normalized, the sequential Bahadur-Kiefer processes 
ii* (•, •) and i?n(-, •), as well as the sequential uniform Vervaat error process 
Qn{-, •), when based on long-range dependent sequences as in (1.2) and (1.4), 
do converge weakly in -D[0,l]2 (cf. Theorems 2.3, 3.2, 4.1 and 4.2), by first 
establishing strong approximations for these processes in sup-norm (cf. The- 
orems 2.1 and 2.2 and Propositions 3.1, 3.2 and 4.2). This new phenomenon 
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in this context will be seen to be due to the limiting processes being Dehling- 
Taqqu type processes (cf. Remark 1.1), that is, multiplications of a nonran- 
dom function by a random process which typically is a power of Y.j-{t), of 
Theorem A. Thus, via strong invariance, we arrive at functional limit theo- 
rems and laws of the iterated logarithm for the sequential Bahadur-Kiefer 
and the sequential uniform Vervaat error processes. 

In Sections 2 and 3 we present strong invariance principles (approxima- 
tions) for the sequential uniform Bahadur-Kiefer process and sequential uni- 
form Vervaat error process of long-range dependent sequences as in (1.2) 
and (1.4), namely, for i?*(y,t) and (5„,(s,t) as in (1.7) and (1.11), respec- 
tively. Section 4 is devoted to establishing analogous statements for the se- 
quential general Bahadur-Kiefer process Rn{y,t) of (1.8) by examining the 
sup-norm distance between the sequential uniform quantile process Un{y,t) 
and the normalized sequential general quantile process pn{y,t) a la Csorgo 
and Revesz [7] and Csorgo and Szyszkowicz [11]. The thus obtained results 
of Proposition 4.2 and Theorems 4.1 and 4.2 constitute a basis for study- 
ing quantiles, quantile and Bahadur-Kiefer processes in the context of long 
range dependent Gaussian subordinated processes. 

The results obtained in this paper for long-range dependent sequences are 
analogs of those in the i.i.d. case in [4, 7, 8, 9, 10, 11, 12, 13]. 

Remark 1.3. Further to long-range dependence, we note that long 
memory moving average models constitute an important and well-studied 
area of interest in time series analysis. In this regard, Koul and Surgailis [26] 
review various results on the asymptotic distribution of empirical processes 
of long memory moving averages with finite and infinite variance. Giraitis 
and Surgailis [22] discuss the uniform reduction principle for the empirical 
process of a long memory moving average process that generalizes the cor- 
responding reduction principle of Dehling and Taqqu [20], which we also 
make fundamental use of in our Propositions 2.1 and 2.2. Thus, in principle, 
it should be possible to extend our present results to long memory moving 
average models as well. However, this extension is not within the immediate 
scope of the present paper. For a comprehensive study of empirical process 
techniques for dependent data in general, we refer to [17, 18]. 

2. Sequential uniform Bahadur Kiefer process, strong approximations. 

2.1. Preliminaries. Throughout this paper we assume that {Xn = G(r/„)} 
and {Un = F{G{r]n))}, n>l, are as in (1.2) and (1.4), respectively, long- 
range dependent random sequences that are governed by the standard Gaus- 
sian random process {r/n} which satisfies (1.1). 

We first derive a strong approximation of the sequential general empirical 

process Pn{x,t) by the process Cr{x)Y}i^iHr{r]i)/T\, by changing the rate 
of convergence in Theorem 3.1 of [20] to fit our purposes in this exposition. 



BAHADUR-KIEFER AND VERVAAT ERROR PROCESSES 9 

Proposition 2.1. Letp be the smallest integer satisfying max(2,T, j^^j^) < 
p < max( ^~^'^ , YTT^)- Then, as n ^ oo, we have 

[nt] 

sup sup Pn{x,t) - d~^Cr{x)y2HT{'n^)/T^■ 
0<t<l ~OD<x<+OD -^-^^ 

= 0(n-'^P/2+rD/4+.) 

with any sufficiently small positive e, where v = m\'n.{D^ 1 — tD)/2. 

Proof. The proof is based on the well-known chaining argument of [20]. 
Hence, while studying the proof of Theorem 3.1 in [20], we shall only briefly 
indicate the extra steps that are needed for us to achieve our goal. 

Let Sn{k\ X, y) = S'„(/c; x) — Sn{k\ y) {—oo <y <x < +oo), where 

k 

Snik; x) = ^{/(X, < x) - F{x) - Cr{x)Hr{m)/T\}, l<k<n. 
1=1 

Then we have 

dnSn{k;x,y)=j: f: ^-Mj1^H,{^,). 

i=lq=T+l ^' 

This means that, for any fixed —oo<y<x< +oo, the Hermite rank of 
dnSn{k;x,y) is at least r + 1. 

First, for 7(-) as in (1.1), we assume that sup„>x |7(^t)| < S, where < 6 < 
(p — 1)~^, and proceed as follows. 

Via Proposition 4.2 of [32], one can verify that 

f k ^ p/2 

E\dnSn{k;x,y)\P < Cip,6,x,y)\kY,h{u)\-+' 

[ u=0 } 

for some positive finite constant C{p,5,x,y) depending on p, 5 and Cq{x) — 
Cqiy)- 

Since | Eai^lzjfkM | < 2 uniformly for any — oo < y < x < +oo, the proof 
of Lemma 4.5 and Proposition 4.2 of Taqqu [32] imply that the constant 
C{p,6,x,y) must be a finite constant for any — oo < y < x < +oo. Letting 
C{p,S,x,y) < C, we get 

f k ^ p/2 

E\dnSn{k;x,y)\P<c\kY,\j{uW+'\ . 

[ u=0 } 

Suppose first < D < {t + 1)"^. Then, by (1.1), as A; ^ oo, 
kj2hi'^W' = 0{k^~^^+'^''L-^'{k)). 

u=Q 
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When D > (r + l)-\ ELo !7(^)r^^ is slowly varying as A; — > oo and, hence, 

k 

kJ2b{uW^' = 0{kLo{k)) 

u=0 

for some slowly varying function Lq{-) at infinity. Thus, we arrive at 
(2.1) E\Sn{k;x,yW<Ck-''P+^-^) <c(-) 



A{x)=F{x)+ f \ElM^^y)dy, 
Jw(v)<x} r! 



dnJ \n, 

with any sufficiently small positive e for any — oo<y<x<+oo, 1 <k <n. 
For any s > 1, define the partition as in [20], 

— OO = 7ro,s < TTl^s < • • • < TT2^,s = +00 

such that 

A(7r,,,-) - A(7ri„i,,) < A(+oo)2-^ i = 1, . . . , 2^ 

\HAy )\ 

l{G(y)<x} r! 

where 4> denotes the density function of the unit normal distribution. 

Given C > 0, let = [\og2{CC~'^nd~^)] + 1. Next, for any x G M and s = 
0,1,..., /C, define by 

One can then define a chain linking — oo to each point x by 

-OO = TTjx^o < TTj^^i <■■■ <X < TTj^^i^K- 

Now using (2.1) instead of Lemma 3.1 of [20] and applying Chebyshev's 
inequality, along the same lines as those of the proof of Lemma 3.2 of [20], 
we obtain 

p| sup \Sn{k;x)\>c\ 

L— oo<a:<+oo J 

<^P<^ sup |5„(A;;7rjj,5,7rjj > C/(s + 3)H 

L-oo<a;<+oo J 



+ P 



i=l 



>2^^-V/4 



/ t.\ {1~u~tD/2)p K /rl,\P 

<C(-) n-^P+'C" E 2'''' (s + 3)2P + C ( ^ ) ^-P2-P(^^'-i) 

V^/ \dn/ 
/t.-s{l~u~TD/2)p 

<ci-] n-'^P+^C"^2^(^ + 3)^^+^ 
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-^N (1-tD/2)p 



+ C{-] n 

n 



-TDp/2+e 



r., / /h\{l~f~rD/2)p / N (l-rD/2)px 



n/ \n 

(l-rD/2)p 



n 



for any ^ G (0,1]- The last inequality is due to the fact that — v — tD /2)p > 
1. 

Let M„(A;)=sup_^<^<+^|5n(fc;x)|, M„(/ci, fca) = M„(/ci) - M„(fc2). On 
applying the above inequality, an appropriate variant of the proof of Theo- 
rem 3.1 of [20] leads to 



p(max|M„(A;)| >C 



k<n 



<^P( max |M„((J-1)2^J2^)|>^^| 



{log2 n log2 n ^ 

s=0 s=0 J 

for some ei > e, where r = log2 n. This implies that, on assuming sup„>i \ j{u) \ < 
6 with0<6 <{p-l)~^, 

(2.2) p(max sup \Sn{k;x)\ >(] < Cn-^P+^^/^+'il + C^-'). 

Now we proceed to establish (2.2) without the assumption sup„>;^ \ < ^■ 
Since ^{u) tends to zero as n ^ oo, there exists a fixed integer M = M{5) > 1 
such that |7(u)| < 5 for all u > M. Thus, without the assumption sup„>i |7(u)| < 
6, we merely have |7(u)| < S for u > M. Along the lines of the proof of The- 
orem 1 of [32], we obtain 



max sup \Sn{k;x)\= max sup 

l<fc<n _oo<x<oo l<fc<" "00<x<cxD 



M 



i=l 

k' 



< 2_, max sup 

l<k<n -oo<x<oo 



i=l 



where G*irji;x) = I{Xi <x) - F{x) - Cr{x)Hr{rji)/T\. 
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Obviously, for each j = 1, . . . , M, the correlations of the sequence {??j+(i_i)M5 
i > 1} are bounded by 6 in absolute value. Let S*{k';x) = x 
J2i=i G* {'t]j+(^i-i)M; x) . Therefore, (2.2) in our present context implies 

P< max sup \Sn{k;x)\>C> 

[l<k<n -oo<x<+oo J 

M . . 

^^^{'^^f sup \Sl{k';x)\>c\ 

That is to say, (2.2) holds without the assumption sup„>;^ |7(^)I < 

We now make use of (2.2) with n = ni = min{j : j > e'} and C = = 
exp{Z(-i/p/2 + tD/A + e)/{p + e)}, / = 0, 1, . . . . Then, by Borel-Cantelh 
lemma, there exists an integer /q such that, for any / > /q, 

max sup |5„;(A;;x)| < exp{— /(z^p/2 — rL'/4 — e)} a.s. 

k<ni -oQ<x<+oo 

Let n > e'" and let I be the integer such that 77,/_i <n<ni. Since e~' < 
and / — > oo as n ^ oo, by definition of (i„ and that of a slowly varying 
function, we have 

sup |S„(n;x)| < ^max sup |5„,(A;;x)| < Cn-'^P/2+rD/4+._ 

—oo<x<+oo dn k<ni -oo<a;<+oo 



This implies that, as — > oo. 



sup ^„ 

-oo<2;<+oo 



dnPn{x, 1) - C^(x) ^ Hr{r]i)/T\ 



i=l 



0(1) 



a.s. 



The latter, in turn, gives that, with fixed t € (0, 1] and (nt) — > oo as n ^ oo, 
we have 



sup 

-oo<x<+oo 



[ni] 

dn(3n(x,t) - Cr{x)^Hr{rii)/T\ 
1=1 

up/2+TD/A+e\ 



0{d[„t]{nt) 

:0((nt)l-^P/2-rD/4+.^r/2(^^)) 



a.s., 



where the constant of O(-) is not a function of t and, by our assumption 
for p, we see that the exponent of (nt)^~''P/^~'^-^/^+^ is positive. Hence, 
without loss of generality, we can assume that the regularly varying func- 
tion {ntY~'^'P/'^~'^^/'^~^^ U'/'^{nt) of positive exponent is a strictly monotone 
increasing regularly varying function of {nt) (cf. 7 of Corollary 1.2.1 of [16] or 
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Theorem 1.5.4 of [2]). Hence, on dividing both sides by n'^~''P/^~^^/^+''L''/^{n), 
the right-hand side is seen to be a.s. bounded, independently of t. Conse- 
quently, we can take supo<t<i on the left-hand side, and thus arrive at the 
result of Proposition 2.1. □ 

In the rest of this paper the marginal distribution function F of {-'^n} in 

(1.2) is assumed to be continuous. We also assume the following: 

Assumption A. Jr{F{x)) and the derivatives J^(F(x)), Jr"{F{x)) with 
r as in (1.3) are uniformly bounded and 

sup \Jr{F{x))\=0{5n) 
0<F{x)<5„ 

for any sequence 5n — > as n — > oo. 

Remark 2.1. Since we assume that F is continuous, if Jr(0) = 0, it 
follows that 

sup \Jr{F{x))\= sup \Jr{F{x)) - Jr{0)\ 

0<F(x)<Sn 0<F(x)<Sn 

< sup F(x)- sup \4{F{e))\ = 0{6n). 

Q<F{x)<5n Q<F{9)<Sn 

Moreover, if we take G as G = F~^^, we see that Ji(F(x)) = -(j){^~^{F{x))) ^ 
for any F{x) G (0, 1), where (j), denote, respectively, the density func- 
tion and the quantile function of the unit normal distribution function 
This means that in this case r = 1 , and elementary calculations show that 
Assumption A holds automatically. Specifically, let G{x) = x, and this is a 
special case of G = F~^^, since now F = Then, for this function G, r = 1 
and Ji(<I>(x)) satisfies Assumption A. 

For the sake of first approximating the sequential uniform empirical and 
quantile processes a„(y,t) and Un{y,t), we define the two-time parameter 
stochastic process {V{y,nt); < y < 1, < t < l,n > 1} by 

[nt] 

(2.3) Viy,nt) = My)J2Hr{7]i)/rl, 

i=l 

and, as an immediate consequence of Proposition 2.1, we conclude the fol- 
lowing strong approximation for the sequential uniform empirical process 
an{y,t). 

Corollary 2.1. Under the assumptions of Proposition 2.1, we have 
sup sup |a„(y,t)-d^V(y,nt)| = 0(n~'^P/2+rZ)/4+£) 

0<t<10<|/<l 

with any sufficiently small positive e, where v = min(L', 1 — tD)/2. 
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Let Kir = SUPo<y<i I Jr(y) I, K2r = SUPo<y<i | Jr(y) • Jr{y)l I^Zr = 

supo<j^<i |«/r(y) ' "^-^(y)!- Via Assumption A, we conclude < , k,2t , H3t < 
oo. Moreover, if we take G = F~^^, by Remark 2.1, it is easy to check that 
Kii = l/(27r)V2, = l/(27re)V2 and K31 = l/{27r(2e) ^2}. 

The process V{y,nt) defined in (2.3) that is approximating an{y,t) as 
in Corollary 2.1 can also be used to approximate the sequential uniform 
quantile process Un{y,t). Namely, we have the following: 

Proposition 2.2. Letp be the smallest integer satisfying max(3r, y^^) < 
p < max( ^'j^'^ , iZ^D ^- Suppose Assumption A holds. Then under the as- 
sumptions of Corollary 2.1, as n^oo, we have 

sup sup \un{y,t) - d~^V{y,nt)\ 

0<t<10<j/<l 

(2.4) 

= 0{n~^^/'^L^/'^{n){log\ognY) a.s. 

Proof. Note that 
Un{y,t) = d~^[nt]{E[nt0[,,t]{y)) - t/[„t](y)} - d~^[nt]{E[,,t0[nt]{y)) - y} 

= an{Ulnt]{y),t) - d~^[nt]{Eint]{U[nt]{y)) - y}, 

and it is easy to see that 

0< sup \EniiJ^t]iy))-y\<i/[nt]. 

0<J/<1 

Thus, we have 

sup sup \un{y,t) - an{y,t)\ 

0<t<10<y<l 

(2-5) _ 

= sup sup |a„([/r„ii(y),t) -a„(y,f)| + 0(d„ ). 

0<t<10<y<l 

Applying Corollary 2.1, estimating the right-hand side of (2.5), we obtain 

sup sup \an{Ulnt]{y),t) - an{y,t)\ 
0<t<10<y<l 

(2.6) = sup sup d~^\V{Uint]{y),nt) -V{y,nt)\ 

0<t<10<y<l 

+ o(n-'^f/2+-«/4+^) a.s. 

Hence, we need to study the size of the random increments of the process 
V{y,nt). 
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The Mori-Oodaira LIL [28] yields 

[nt] 



1=1 



limsupn'^^/^ "'^(L(n) loglogn) '^^'^ sup 
n^oo 0<i<l 

(2.7) 

2(r+l)/2 

~ ^Jt\{2-tD){1-tD) 
Hence, by (2.3) and the fact that < < oo, we have 

hmsup(loglogn)~'^/^ sup sup d~^\V{y^nt)\ 

n-^oo 0<t<10<v<l 

{2r 

T-O- I W. 

a.s. 



2(^+i)/2. 



^/t\{2 - tD){1 - tD) 
Consequently, via Corollary 2.1, we conclude 

limsup(loglogn) ^/ sup sup \aniy,t)\ = ^ a.s., 

n^oo 0<i<10<?/<l y'T\[2 — tD)[1 — tD) 

and this in turn gives 

limsup(loglogn)~'^/^ sup sup \un{y,t)\ 

n— »oo 0<t<10<i/<l 

(2.9) 

2(-+i)/2ki. 

~ y/Tl{2-TD){l-TD) 

on account of 

sup sup \an{y,t)\ = sup sup \un{y,t)\. 

0<t<10<y<l 0<t<10<y<l 

On the other hand, by the mean value theorem, we arrive at 

\Jr{Un{y)) - Jr{y)\ = \Un{y) " y 1 1 4 (^i„ (y) ) | , 

where \y — din{y)\ < \Uniy) — y\- Now (2.9) with t = l implies that, as n ^ oo, 

sup \Un{y)-y\= sup (i.„n" V„ (y, 1)| 
0<y<l 0<y<l 

(2.10) 

= 0{{n~^L{n) loglogn)^/^) ^ 

almost surely [we note in passing that (2.10) is just a Glivenko-Cantelli 
theorem with rates of convergence in terms of the long-range dependent 
sequence as in (1.4)]. Thus, by Assumption A, as n — > oo, we arrive at 

sup iJriUniy)) - Jriy)] 

0<y<l 

= 0((n~^L(?i) log log n)^"^^) a.s. 
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The latter combined with (2.7) for t = l yields 

sup d~'\V{Un{y),n)-V{y,n)\ 

0<y<l 

(2.11) 

= 0{n-^^/^L^/^{n){loglogny) a.s. 

Using (2.5)-(2.6), (2.11) and our assumption for p, we arrive at 

sup |un(y,l) -a„(y, 1)1 
0<y<i 

(2.12) 

= 0(n-^-°/2L^/2^n)(loglogn)^) a.s. 

Now (2.12) combined with Corollary 2.1 with t = 1 yields 

sup \un{y,l) -d~^V{y,n)\ 
0<y<i 

= 0{n~^^/^L^/^{n){loglogny) a.s. 

On multiplying through by dn and then applying a similar argument as used 
at the end of the proof of Proposition 2.1, we conclude (2.4). □ 

Next, in view of (2.5) and (2.6), we establish the exact size of the random 
increments of the process V{y,nt) for convenient use later on. 

Proposition 2.3. Under the assumptions of Proposition 2.2, we have 
limsupn'^'^~^(L(n) loglogn)"^ sup sup \V{U!nt]{y),nt) — V{y,nt)\ 

n^oo 0<t<lO<y<l 
2^+1 K2r 



t\{2-tD){1-tD) 
Proof. We note that 

Jr{Un{y)) - Jr{y) 



a.s. 



= J'Ay){Un{y) -y) + \{Un{y) - yT Jr" {eM) 

= -j;(2/)n-V(y,n) + J',{y) dnn~\d~^V{y,n) - Un{y)) 

+ \0n{y)-yfJr"{e2n{y)), 

where \y — 02n{y)\ < \Un{y) —y\- Consequently, by (2.4) with t = l and (2.10), 
we obtain 

sup |4(y)d„n~^(n„(y) - d~^V{y,n))\ 
0<y<i 

= 0((n~^L(?i) log log Ti)^) a.s. 
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and 



sup \\{Un{y)-yfjr"{e2n{y))\ 
0<?/<l 

= 0((n~'^L(n) log log n)^) a.s. 



Hence, 



sup \Jr{Un{y)) - Jr{y) + JUy)n~^V{y,n)\ 
0<y<l 

= 0((ri~^L(n) loglogn)^) a.s. 
Now (2.7) with t=l implies 

limsup(n~'^L(n)loglogn)~'^/^ sup | Jr (t^n(y)) - -^r(y)| 

n^oo 0<y<l 



^tI{2-tD){1-tD) 
almost surely and, again by (2.7), we conclude that 

limsupn^^~^(L(?i) loglogji)""^ sup \V{Un{y),n) — V{y,n) 

n^oo 0<3/<l 



a.s. 



t\{2 - tD){1 - tD) 
Hence, we have, with t £ (0, 1) fixed, as (nt) — > oo, 



+ o(l)^ (nt)i~^^L^(nt)(loglog(ni))^ a.s., 



sup \V{U[nt]{y),nt) -V{y,nt)\ 
0<y<l 

y.{2 - tD){1 - tD) 

and hence, on dividing both sides by n^^'^'^L'^(n)(loglogn)'^ and assuming 
without loss of generality that the regularly varying function n^~'^^L'^{n) 
of positive exponent is strictly monotone increasing, the right-hand side is 
seen to be a.s. bounded and independent of t. Thus, on taking supo<f<i on 
the left-hand side, we conclude the proof of Proposition 2.3. □ 

Proposition 2.4. Under the assumptions of Proposition 2.2, as n ^ 
oo, we have 

sup sup \V{U<nt]{y),nt) -V{y -[nt]-'^V{y,nt),nt)\ 

0<t<10<j/<l 

= Oin^'^^^/^{L{n)loglognf^^^) a.s. 
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or, equivalently, 

sup sup \{V{Uint]{y),nt) -V{y,nt)) 

0<t<10<y<l 

- {V{y - [nt]~'V{y,nt),nt) - V{y,nt))\ 
= 0{n^"^^^l'^{L{n) loglogn)3^/2) a.s. 

Proof. Notice that 

V{Un{y),n) = V{y - n" n) - A„(y), n), 

where A„(y) = dnn~^{un{y, 1) — d~^V{y, n)). By Proposition 2.2 with t=l, 
we get 

sup |A„(y) I = 0((n~^L(n) log log n)^) a.s. 
0<y<i 

Consequently, along the lines of the proof for (2.11), we obtain 

sup \V{Un{y),n) -V{y -n~^V{y,n),n)\ 
0<y<i 

This also completes the proof of Proposition 2.4 by using a similar argument 
as at the end of the proof of Proposition 2.3. □ 

Proposition 2.5. Under the assumptions of Proposition 2.2, we have 



sup sup 

0<i<10<t/<l 



V{y-[nt]-^V{y,nt),nt) 



[nt] 



(2.13) 



and 



Viy,nt) + [nt]-W{y,nt)4iy)J2Hr{ni)/T\ 



i=l 



: 0{n^-^^^/'^{L{n) loglog?i)3^/2) a.s., 



n — oo, 



(2.14) 



limsupn^'^ "^(L(n) log log ?i) 

n— >c» 

X sup sup \V{y — [nt]~^V{y,nt),nt) — V{y,nt)\ 

0<t<10<y<l 
= limsup n^^~^{L{n) log logji)""^ 



X sup sup 

0<t<10<j/<l 

t\{2-tD){1-tD) 



[nt] 



it]-^v{yM)Jr{y)T.Hr{m)/T\ 



i=l 



a.s. 
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Proof. By (2.8) and (2.10), respectively, as n^oo, we have 

sup n~^\V{y,n)\ = 0{{n~^L{n)loglogny^'^) a.s. 
0<y<i 



and 



sup \Un{y) — y\ = 0{{n ^L(n) loglogn)^^^) a.s. 
o<y<i 



Hence, along the lines of the proof of Proposition 2.3, we first obtain (2.13) 
and (2.14) with t = l, and then a similar argument as at the end of the proof 
of Proposition 2.3 yields (2.13) and (2.14) as stated. □ 

2.2. Strong approximations of sequential uniform Bahadur-Kief er pro- 
cesses. A direct application of Corollary 2.1 and (2.5) leads to a strong 
approximation for the sequential uniform Bahadur-Kiefer process i?*(y,4). 

Theorem 2.1. Under the assumptions of Corollary 2.1, as n — > oo, we 
have 

sup sup \Rl{y,t)-(y{y,nt)-V{Uird]iy),nt))\ 

0<t<10<y<l 

= sup sup \dn{an{y,t) -Un{y,t)) - {V{y,nt) - V{Uint]{y),nt))\ 

0<t<10<y<l 
= 0(nl-^P/2-rD/4+e^r/2(^)) 

Next we reformulate Theorem 2.1 as follows. 

Theorem 2.2. Under the assumptions of Proposition 2.2, as n^oo, 
we have 



sup sup 

0<t<10<j/<l 



t]Kiy,t)-My)JUy)[j2Hr{m)/rl 

\i=l / 



Proof. Propositions 2.4, 2.5 and Theorem 2.1 imply the result. □ 

These strong approximations readily yield weak convergence and laws of 
the iterated logarithm for the process i?*(y,t). 

Theorem 2.3. Under the assumptions of Proposition 2.2, as n^oo, 
we have 

n^^~'L~^n)[nt]K{y,t) ^ ^-—^^-—^^J,{y)J^{y)Y^\t) 
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in the space D[0, 1]^, equipped with the sup-norm, where is as in The- 

orem A. 

Proof. From Theorem 5.6 of [33], as n ^ oo, we conclude 

[nt] 



i=l 

in D[0, 1]. Now Theorem 2.3 follows from Theorem 2.2. □ 



<"i:^-"">/-'-\/ (2-rD)(l-.I)) ^-"> 



In light of Theorems 2.2 and 2.3, we have the following: 

Theorem 2.4. Under the assumptions of Proposition 2.2, we have 
limsup7i'^^~^(L(n) loglogn)"^ sup sup \[nt]R'^{y,t)\ 

n^co 0<t<10<y<l 

(2.15) 

tI{2-tD){1-tD) 

as well as 

n^^-'^L~^{n) sup sup \[nt]R*^{y,t)\ 
0<t<10<y<l 

(2.16) 

T> 2k2t v2/+\ 

Proof. Equation (2.15) follows from Theorem 2.2 and the law of the 

srated logarithm (2.7) f 
Theorem 2.3 directly. □ 



iterated logarithm (2.7) for HriVi) /t- As to (2.16), it results from 



Denote the Lp-norm of a function / on [0, 1]^ by 

"1 /•! \ i/p 



\f{y,t)\Pdydtj , l<p<oo. 



A straightforward Lp- version of Theorem 2.2 for the sequential uniform 
Bahadur-Kiefer process R^{y,t) results in the following: 



Theorem 2.5. Under the assumptions of Proposition 2.2, we have 

2r+l|| J' II 

limsupn^-°"2(L(n)loglogn)-^||[ni]i2;||p = — ^ a.s., 

n^oo T'.[Z — t1J)[L — TJJ) 

as well as 



tD-2t~t/ Mir J.1 II ^ 2 II J-T'^r lip in^2|| 

n L (n)||[ni]i?„||p — > (2-TD){l-TDy ^ ^ 



BAHADUR-KIEFER AND VERVAAT ERROR PROCESSES 



21 



This is in contrast to the Lp-theory of the Bahadur-Kiefer process in 
the i.i.d. case in [9, 10], which deviates substantially from its [23, 24] sup- 
norm theory. For a review of this matter, we refer to [4]. For the sake of 
comparison to the latter theories. Theorems 2.1-2.5 above should be read 
with t = l. For strong approximations in sup-norm of the sequential uniform 
Bahadur-Kiefer process in the i.i.d. case, we refer to [11]. 

3. Asymptotics of the uniform Vervaat error process. In support of 
studying the sequential uniform Vervaat error process, we first derive the 
weak convergence of the sequential uniform Vervaat process V^(-,-) [cf. 
(1.10)]. This can be easily done via Theorems 2.2 and 2.3. 

Theorem 3.1. Under the assumptions of Proposition 2.2, as n—>oo, 
we have 

in the space -D[0, 1]^, equipped with the sup-norm, where 1^(0 is as in The- 
orem A. 

Proof. Theorem 2.3 and integration by parts yield 

Vn{s,t) = 2d-^[nt] r R;Xy,t)dy 
Jo 

= (2-rZ))a-.P) -'-'"^-'"' □ 

Theorem 3.1 and Corollary A imply that the sequential uniform Vervaat 
process 14 (s, t) and the process a'^{s, t) have the same weak limiting process. 
Thus, just as in the i.i.d. case, it makes sense to consider the deviation of 
the two processes, that is, the sequential uniform Vervaat error process Q„ 
as in (1.11). Unlike in the i.i.d. case (cf. [4]), we shall see that Q„(s,l), as 
well as its sequential version Qn{s,t), do converge weakly and, in particular, 
to a random process which is a multiplication of a nonrandom function by 
the cube of the random process 5^(t) of Theorem A. 

Proposition 3.1. Under the assumptions of Proposition 2.2, we have 

sup sup [ni]|Q„(s,t)-Z„(s,t)| = 0(ni-'^P/2+-^/^+^(loglogn)^/2) a.s., 
0<t<10<s<l 
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where {Zn{s, t), < s, t < 1, n = 1, 2, . . . } is defined by 
Zn{s,t) = 2d~^V{s,nt) 

(3-1) . 

X / {V{s-w[nt]~^V{s,nt),nt)-V{s,nt))dw. 



Proof. We proceed a la the lines of the proofs of Lemmas 3.1 and 3.2 
of [4]. Let 

Anis,t) = 2d~'^[nt] f {an{y,t) -anis,t))dy, 

(3.2) 

< s,t < l,n = 1,2,.... 

It follows from Lemma 3.1 of [4] that 

Qn{s, t) = An{s, t) - d-\Rl{s, t))\ 

Now (2.15) with t = l yields that, when n — s- oo, 

sup n|Q„(s, 1) - An{s, 1)1 = 0(ni-"^L-(n)(loglogn)2-) a.s. 

0<s<l 

In similar fashion as at the end of the proof of Proposition 2.1, as n ^ cx3 

we get 

sup sup [ni]|Q„(s,t) - A„(s,t)| = 0(n^-^^L^(n)(loglogn)2^) a.s. 

0<t<10<s<l 

Hence, it suffices to show that, as oo, 

sup sup [nt]\An{s,t) - Zn{s,t)\ = 0(nl-^P/2+rD/4+e^^Qg^Qg^)r/2) 
0<t<10<s<l 

Changing variable y = s — w{s — ^7[„f](s)) = s — w[nt]~^ dnUn{s,t) in (3.2), 
we get 

An{s,t) = 2un{s,t) [ {anis - wlnt]'^ dnUnis,t)) - an{s,t))dw. 
Jo 

Corollary 2.1 and (2.9), as n — > oo, yield 

An{s,t) = 2d~^Un{s,t) 

(3.3) x[ {V{s-w[nt]~^dnUnis,t),nt)-V{s,nt))dw 

Jo 

+ Oin-'P/^+^^/^+'iloglogny/^) a.s., 

uniformly in s,t G [0, 1]. For all < < 1, according to Proposition 2.4, as 
n ^ oo we have, uniformly in s, t G [0, 1], 

V{s — w[nt]~^ dnUn{s, t),nt) = V{s — w[nt]~^V{s, nt),nt) 

+ 0(nl-=^^^/2 log ^)3r/2) ^ 
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Inserting this into (3.3) and applying (2.9) again, we obtain, uniformly in s, 

Anis,t) = 2d~'^Unis,t) [ {V{s - w[nt]~^V{s,nt),nt) -V{s,nt))dw 





+ 0(n-^^L^(n) (log log n)2^) a.s. 
Consequently, as n — > oo, uniformly in s,t e [0, 1], 
An{s,t) = 2d~^Un{s,t) 

(3.4) X / {V{s-w[nt]-W{s,nt),nt)-V{s,nt))dw 

Jo 

+ 0(n"^P/2+rD/4+£(j^g j^g ^ 

Now, from Proposition 2.2, as n — > oo, 

(3.5) 2d-^Un{s,t) = 2d-'^V{s,nt) + 0{n'\loglogny) a.s. 

uniformly in < s, t < 1. On the other hand, applying (2.14) to the integrand 
in (3.4), we arrive at 

1 

{V{s - w[nt]-'^V{s, nt),nt) - V{s, nt)) dw 
= 0{n^-^^{L{n)\og\ognY) a.s. 







uniformly in < s,t < 1. Inserting this and (3.5) into (3.4) yields that, as 
n oo, 

[nt]\An{s,t) - Zn{s,t)\ = 0(ni-'^^'/2+-^/4+^'(loglogn)^/2) a.s. 
uniformly in < s,t < 1. This concludes the proof of Proposition 3.1. □ 

Due to Proposition 2.5, we present the following conclusion. 

Proposition 3.2. Under the assumptions of Proposition 2.2, we have 



sup sup 

0<t<10<s<l 



[nt] 

Zn{s,t) + 2d-\nt\-\V{s,nt)fj',{s)Y,H^{r^i)/T\ 

i=l 



0{n-^^r{n){log\ognf^) a.s. 
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Proof. By (3.1) and Proposition 2.5, we obtain 



sup sup 

0<t<10<s<l 



[nt] 



1=1 



Zn{s,t)+2d-^[ntr\V{s,nt)fj'r{s)Y.Hr{r]i)/r\ 
2d-^V{s,nt) 



sup sup 

0<t<10<s<l 



X / \v{s-w[nt]~'^V{s,nt),nt)-V{s,nt) 



[nt] 



+ w[nt]-^Vis, nt)4{s) J2 Hr{m)/T\ \ dw 



1=1 



< sup sup \2d^ V{s,nt)\ 

0<t<10<s<l 



X sup sup 

0<t<10<s,w<l 



V{s -w[nt]~^V{s,nt),nt) 



[nt] 



V{s, nt) + w[nt]-^V{s, nt)J'^{s) ^ Hr{vi)/rl 



i=l 

= 0{n-^^L^{n){\oglognf^) a.s. 
This completes the proof. □ 

The main conclusions of this section are as follows. 

Theorem 3.2. Under the assumptions of Proposition 2.2, as n^oo, 
we have 

n^''^^-'L-^/\n)[nt]Qn{s,t)^2'/\i2-TD){l-TD)r''/^4is)4{s)Y,\t) 

in the space D[0,1]'^, equipped with the sup-norm, where is as in The- 

orem A. 

Proof. It follows from Theorem 5.6 of [33] and Propositions 3.1 and 
3.2. □ 

As a consequence of Propositions 3.1 and 3.2 and Theorem 3.2, we have 
the following results. 

Theorem 3.3. Under the conditions of Proposition 2.2, we have 
limsupn^-°/2~^L-^/2(^)(lQglQg^)-3r/2 ^^^^ \[nt]Qn{s,t)\ 

n^oo 0<t<10<s<l 

= 2(3^+5)/2^3^(^,(2 _ rD){l - TD)y^''^ a.s., 
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and, as oo, 

7i^^/^'^L~^/^{n) sup sup \[nt]Qn{s,t)\ 

0<t<10<s<l 

^25/2K3.((2-ri^)(l-rZ)))-=^/2 sup \Y,'{t)\. 

0<t<l 

Moreover, 

limsnpn^^^^-^L-^/^{n){log\ogn)-^^/^\\[nt]Qn\\p 

n— >oo 

= 2(3-+5)/2|| j2j^||^(^!(2 - tD){1 - tD))-'^/'^ a.s., 
and, as oo, 

ri^'''^~^L~^'Hri)\\[nt]Qn\\p^2'>'^\\J^,J%{{2-TD){l-TD)^^^^^ 
where, in hath cases, is as in Theorem A. 

Reading Theorems 3.2 and 3.3 with t = 1, they should be compared to 
Theorem 2.1 and Corollaries 2.1 and 2.2 of [4] in the i.i.d. case. 

4. Sequential general Bahadur Kiefer processes, strong approximations. 

In this section we study the sequential general Bahadur-Kiefer process 
Rn{y,t) in terms of the sequential uniform Bahadur-Kiefer process R'^d/jt). 

The following Csaki-type law of the iterated logarithm (cf. [3]) for the 
sequential uniform quantile process plays a crucial role in comparing the 
two processes pn{y,t) and Un{y,t). 

Proposition 4.1. Assume that the assumptions of Proposition 2.2 hold. 
Then, as oo we have 

sup |'Un(2/,l)lVy(l - y) = 0((loglogn)'") a.s., 

'5n<l/<l-5n 

where (5„ = (n^^L(n) log log n)'^. 

Proof. Note that 
sup \ul{y,l) -\d~^V{y,n)\^\/y 

S„<y<l/2 

< sup \un{y,l) -d~^V{y,n)\'^ ■5~'^ 

0<i/<l 

+ 2 sup \d-Wiy,n)\/y^/^ sup |u„(y, 1) - d-V(y,n)| • ^^^^ 

S„<y<l/2 0<y<l 
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Assumption A and simple calculations yield 

sup \Jr{y)\ly^'^ = 0{l) and 
K<y<l/2 

(4.1) 

sup |J.(y)|/(l-y)V2 = 0(i) 

l/2<y<l-<5„ 

for large enough n. Consequently, (2.4), (2.7) and (4.1) imply that, as n 
oo, 

sup \ul{y,l)-\d~W{y,n)\'^\/y = 0{{loglognY) a.s. 

Sn<y<i/2 

Similarly, as n — > oo we get 

sup \ul{y,l)-\d-^V{y,n)\''\/{l-y) = 0{{loglognY) a.s. 

l/2<|/<l-5„ 
This, in turn, results in 

(4.2) sup = C'((loglogn) ) a.s. 

5u<y<i~K y{^-y) 

On the other hand, by (2.8) and (4.1) we know that, as n — > oo, 

sup |(i-V(2/,n)|V(y(l-y)) = 0((loglogn)^) a.s. 

in<y<l-S„ 

Thus, via (4.2), as n — > cx) we arrive at 

(4.3) sup \un{y,l)\^/{y{l-y)) = 0{{loglognY) a.s. 

In light of Proposition 4.1, and Lemma 1 of [7] (cf. Lemma 4.5.2 in [8]), 
it is natural to introduce the following conditions: 

(i) F is twice differentiable on {a,b), where 

a = sup{x : F (x) = 0} , 6 = inf{x : F(x) = 1}, — cxd < a < 6 < +00; 

(ii) F'{x) = f{x)>Oon (a, 6); 

(iii) for some < 7 < 1 + {tD)/{2 - 2tD), we have 

sup F{x){i-F{x))\^= sup yi^-y)W^<r, 
a<x<b o<j/<i J {Q{y)) 

(iv) A := lim^iafix) <oo, B := lim^-^bf{x) < 00; 

(v) min(^,i?) > 0, or 

(v') if j4 = (resp. B = 0), then / is nondecreasing (resp. nonincreasing) 
on an interval to the right of a (resp. to the left of b). 



□ 
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The following proposition concludes a strong approximation of the general 
quantile process Pni',-) by V{-,-) of (2.3). Thus, it parallels Proposition 2.2 
concerning Uni-,-)^ a-nd it is achieved by studying the sup-norm distance 
between pn{y,t) and Un{y,t). 

Proposition 4.2. Assume the conditions (i)-(iii) on F and the as- 
sumptions of Proposition 2.2. Then, as n^oo we have 

sup sup \pn{y,t) -d~^V{y,nt)\ 

0<t<lS„<y<l-Sn 

(4.4) 

= 0{7i-^^/^L^/^{n){loglogn)^) a.s., 

where 5„ = (n~^L(n) loglogn)"^. //, in addition to (i)-(iii), we also assume 
(iv) and (v) [or (v')], then 

sup sup \pn{y,t) - d~'^V{y,nt)\ 

0<t<10<s/<l 



(4.5) 



a.s., 



( 0(n-^^/2L^/2(n)(loglogn)^+i), 
0<7< 1, 

^<^<^ + 2(r-^' 

where C > is arbitrary. 

Proof. Observe that a two-term Taylor expansion gives 
Pn{y, 1) = d-'nf{Q{y)){Q{y) - Q^iy)) 
(4.6) = d~'nf{Q{y)){Q{y) - Q{Un{y))) 

= ..(,,l)--n.(,) ^3^^^^^^^^^^^ /(Q(,)), 

where |y - 6'3„(y)| < |y - C/„(y)|. 

By (4.1), arguing as in the proof of Theorem 4.5.6 of [8], we arrive at 

n , ^„ n , ^^ lr(Q(^3n(y)))| ^ 



and 

ffOM) rg3n(y)(i-i/) , y[i-0-in{y)) V , 



f{Q{y)) ^ 

sup sup 

5r,<y<i-5r. f{Q{Ozn{y))) ~ 5r,<y<i~sAy{l-0zn{y)) ' 93n{y){l-y) 
These, together with Proposition 4.1 and (4.6), yield 

sup \pn{y,l)-u,,{y,l)\=0{n--''/^L^/\n)iloglognr) a.s. 



28 M. CSORGO, B. SZYSZKOWICZ AND L. WANG 

Hence, arguing as at the end of the proof of Proposition 2.1, we conclude 

sup sup \pn{y,t) - Un{y,t)\ 
0<t<15„<i^<l-<5„ 

(4.7) 

= 0{n^^^/^L^/^{n){log\ognY) a.s. 

Now (2.4) and (4.8) together imply (4.4). 

Next, assuming now (iv) and (v), consider the one-term Taylor expansion 
as in (1.6), 

Pn[y,t) = un{y,t) 

f[Q[Oniy,t))) 

It follows from Assumption A in combination with (2.4) and (2.7) that 
(4.8) sup sup \un{y,t)\=0{n~^^L^{n){loglognf^/^) a.s. 

0<t<10<j/<<5„ 



and 



sup sup \un{y,t)\ = 0{n '^^L'^(?i)(loglogn)^'^/^) a.s. 
0<t<i i-Sn<y<i 



Hence, we have 

(4.9) 
and 



sup sup \pn{y,t) -Un{y,t)\ 

0<t<10<y<5n 

= 0(n"^^/2L^/2(n)(loglogn)^) a.s. 



(4.10) 



sup sup \pn{y,t) -Un{y,t)\ 

0<t<l l~5n<y<l 



= 0{n~^^/^L^/^{n){loglognY) a.s. 

Using (2.4), (4.8), (4.9) and (4.10), we get 

sup sup \pn{y,t) - d-W{y,nt)\ 
0<t<10<j/<l 

(4.11) 

= 0(n-^^/2L^/2^n)(loglogn)^) a.s. 

Finally, we assume (iv) and (v'). In order to prove (4.5), it again 
suffices to show that supo<«x supQ<j^<5^ |p.„(y, t) — u„(y,t)| and 
supo<t<i supi_g^^y^^ \Pn{y,t) —Un{y,t)\ Converge to zero a.s. under assump- 
tions (iv) and (v'J. We demonstrate this only for the first one of these, since, 
for the second one, a similar argument holds. 

Along similar lines to the proof of Theorem 4.5.6 in [8], we conclude 

|pn(y,l)| < hn(y,l)| iiUn{y)>y, 
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\pn{yA)\ < < 



a.s., 



and if Un{y) < y, then 

' OK^/2L-"/2(n)5„), 
0<7<1, 
0(n^^/2L-^/2(n)(5„loglogn), 
7 = 1 

OK^/2L-^/2(n)5>^-i(logn)(i+^)(^-i)), 
tD 

where C > is arbitrary. Note that -tD/2 < (1 - TD)-i + tD/2 - 1 < if 
1 < 7 < 1 + {tD)/{2 - 2tD). Hence, with the help of (4.8), we obtain 

sup \pn{y,l) -Un{y,l)\ 
0<y<5„ 

{ 0(n-^^/2L^/2(7i)(loglogn)^+i), 
0<7< 1, 

(9(j,{l-rD)7+rD/2-l^r7-r/2(^)(l0g^)(l+C){7-l)) 



a.s.. 



1 < 7 < 1 + 



tD 



(4.12) 



2(1 -tD)' 

This, combined with Proposition 2.2 and (4.11), completes the proof of 
Proposition 4.2. □ 

Remark 4.1. Note that 

{Rn{y,t)-Rl{y,t),Q<y,t<l,n = l,2,...} 

= {-dn{Pn{y,t) - Uniy,t)),0< y, t < 1, n = 1, 2, . . . }. 

The relationship (4.12) clearly indicates that the results we have summarized 
and proved in Theorems 2.3-2.5 for i2*(y,t) can be immediately restated 
for the sequential general Bahadur-Kiefer process Rn{y,t) via the strong 
invariance principle of Proposition 4.2. So we spell out and summarize these 
results for Rn{y,t) without proof. 

Theorem 4.1. Assume the conditions (i)-(iii) on F and the assump- 
tions of Proposition 2.2. Then, as n —> oo we have 

^^^-^L-^n)[nt]Rn{y, t)I{6n <y<l-6n} 
2 



n 



V 



-Jr{y)Jr{y)Yht) 



{2-tD){1-tD) 

in the space Z)[0, 1]^ equipped with the sup-norm, where 6n = {n~^L{n) x 
log log n)"^. Moreover, 

limsupn'^^~2(L(n) loglogn)""^ sup sup |[ni]i?„(y, t)| 

n^QO 0<t<l 5n<y<l-Sn 
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tI{2-tD){1-tD) 

and, as oo, 

n-^-2L--(n) sup sup | [ni]i?„(y, t)| ^ ^ sup Y,'{t). 

0<t<15„<y<l-5„ - tJJ){L - tJJ) o<t<l 

Theorem 4.2. In addition to the conditions in Theorem 4.1, we assume 
(iv) and (v) [or (v')]. Then, as n^oo we have 

n-^-'L-^n)[nt]Rn{y,t) ^ ^^--^1^— J,(y)4(y)y^2(^) 

in the space D[0,1\'^, equipped with the sup-norm, as well as 

limsupn'^^~^(L(n) loglogn)^"^ sup sup \[nt]Rn{y,t)\ 

n^oo 0<t<10<y<l 



a.s. 



and 



t\{2-tD){1-tD) 
rf^-'^L~''{n) sup sup \[nt\Rn{y,t)\ 



0<t<10<y<l 
V 2k2t 



sup Y^{t), n—^oo. 



i2-TD){l-TD) o<t<i 

Moreover, 

limsupn^'^"^(L(n)loglogn)"^||[ni]i2„||p = ^^(^2 - tD){1-^tD) 



and, as oo. 
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